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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to sound recording and 
reproduction systems. More particularly, the present invention relates to local 
5 performance simulation. 

2. Discussion of the Related Art 

Sound recording and reproduction has long been the subject of research, 
development and debate. Conventional stereophonic practices create a musical 
environment for the listener by including recording environment information, 

10 specifically early reflections and reverberation. Recording engineers therefore 
pay close attention to the recording hall and the location of the microphones 
when they record ensembles. When the original recording has inadequate 
environment information, such information is typically added artificially through 
electronic reverb boxes and ambience synthesizers. Artificial addition is essential 

15 when the original recording is made electronically or by tight-miking techniques. 

The value of replacing recording environment effects with the actual 
effects of the listing environment, therefore, have largely gone overlooked. There 
are many circumstances, however, in which it is quite desirable to simulate a 
"local performance." For example, there is a small but significant market of 

20 classical music connoisseurs who would greatly value the experience of a string 
quartet playing in the comfort of their own homes. Another benefit of local 
performance simulation is the possibility of elimination of intermodulation (IM) 
distortion between the tones of different instruments. Because the tones of a 
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musical instrument tend to be harmonic, local performance simulation would limit 
distortion to harmonic distortion only, causing only a slight change in coloration 
for the instrument. 

It is also desirable to provide the ability to highlight a particular musical 
5 instrument in an ensemble for educational purposes. Similarly, local performance 
simulation would allow the tone color of each instrument to be varied to taste. 
For instance, when listening to a simulated quartet, the listener could elect to give 
the second violin a darker tone color to exaggerate the difference between it and 
the first violin. There is also a need to individually shut off any instrument of the 

10 ensemble to provide a "music-minus-n" system. The local performance 
technique would allow the performer to feel that the other musicians of the 
ensemble are with her and around her, in the same listening environment. 
Furthermore, because each instrument would be recorded separately, editing of 
recordings and processing of individual voices would be facilitated. Errors by one 

15 musician could be corrected without the participation of the other musicians. It is 
also desirable to optimize loudspeakers for their particular functions. This would 
eliminate the present need, for example, for a large low-frequency driver (woofer) 
in the system that is dedicated to a flute. Dedicating loudspeaker systems would 
therefore control the cost of multi-channel ensembles. 

20 Present stereophonic practice sometimes attempts to localize sound 

images, but localization is psychoacoustically fragile. This means that present 
audio imaging approaches depend on the loudspeakers, listening environment, 
and listener position used by the ultimate consumer. Adding to the difficulty is the 
fact that the principle function of stereo is to de-localize the sounds from the 

25 loudspeaker positions themselves and to provide a broadened image. In other 




words, stereophonic recording by definition attennpts to bring the listener into the 
recording environment instead of bringing the musical performance into the 
listening environment. Furthermore, conventional stereophonic sound 
reproduction and contemporary surround sound techniques require the listener to 

5 be in a particular place or area. It is thus desirable to provide a sound recording 
and reproduction system with accurate imaging capability. This capability would 
allow the listener to perceive the individual instruments or voices to be spatially 
compact, and well-localized in azimuth, elevation and distance. Furthermore, it 
would be desirable to allow the listener to walk entirely around the synthesized 

10 performing ensemble. 



SUMMARY OF THE INVENTION 
In view of the above, a need exists for a system capable of accurately 
simulating the radiation pattern of each instrument in an ensemble. Accordingly, 
the present invention provides a method and system for simulating an ensemble 
15 sound pattern. The local performance simulation system includes a signal 
generation system for simultaneously generating contact recording signals based 
on vibrations from an ensemble, where the ensemble produces an audible 
ensemble sound pattern. A signal processing system channelizes the contact 
recording signals and generates final instrument signals based on the 
20 channelized contact recording signals. The simulation system further includes a 
reproduction system for generating audible sound waves based on the final 
instrument signals, where the sound waves simulate the ensemble sound pattern. 

Thus, the method includes the steps of simultaneously generating contact 
recording signals based on vibrations from the ensemble, where the ensemble 
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produces an audible ensemble sound pattern. The contact recording signals are 
channelized, and final instrument signals are generated based on the 
channelized contact recording signals. The method further provides for 
generating audible sound waves with a reproduction system based on the final 
5 instrument signals, where the sound waves simulate the ensemble sound pattern. 

In another aspect of the invention, a method fortuning a local performance 
simulation system is provided. The tuning method includes the steps of matching 
a system overall frequency response to a known overall frequency response, and 
matching a system coarse asymmetrical frequency response to a known coarse 

10 asymmetrical frequency response. A system fine asymmetrical frequency 
response is further matched to a known fine asymmetrical frequency response. 
The system overall frequency response, system coarse asymmetrical frequency 
response and system fine asymmetrical frequency response simulate a 
frequency response of an audible ensemble sound pattern produced by an 

15 ensemble. 

Further objects, features and advantages of the invention will become 
apparent from a consideration of the following description and the appended 
claims when taken in connection with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
20 The objects and feature of this invention will become further apparent from 

a reading of the following detailed description taken in conjunction with the 
drawings, in which: 

Figure 1 is a block diagram of a local performance simulation system 
according to the preferred embodiment of the present invention; 
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Figure 2 is a perspective view of a string quartet according to the preferred 
embodiment of the present invention; 

Figure 3 is a block diagram of a signal generation system according to the 
present invention; 

5 Figure 4 is a perspective view of a pair of contact transducers as applied 

to a cello according to the present invention; 

Figure 5 is a block diagram of a signal processing system according to the 
present invention; 

Figure 6 is a block diagram of a storage system for a signal processing 
10 system according to the present invention; 

Figure 7 is a block diagram of a retrieval system for a signal processing 
system according to the present invention; 

Figure 8 is a perspective view of a reproduction system according to a 
preferred embodiment of the present invention; 
15 Figure 9 is a sectional top view of a loudspeaker system according to the 

present invention; 

Figure 10 is a flowchart of a process for tuning a local performance 
simulation system according to the present invention; 

Figure 11 is a flowchart of a process for matching overall frequency 
20 response according to the present invention; 

Figure 12 is a flowchart of a process for matching coarse asymmetrical 
frequency response according to the present invention; 

Figure 13 is a flowchart of a process for matching fine asymmetrical 
frequency response according to the present invention; and 
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Figure 14 is a block diagram demonstrating the process of matching 
overall frequency response according to the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
As illustrated in Figure 1, a local performance simulation system 20 
5 simulates an ensemble sound pattern by producing sound waves which simulate 
the ensemble sound pattern. The simulation system 20 has a signal generation 
system 30, a signal processing system 50, and a reproduction system 70. The 
signal generation system 30 simultaneously generates contact recording signals 
based on vibrations from an ensemble 21, where the ensemble 21 produces an 

10 audible ensemble sound pattern. The signal processing system 50 channelizes 
the contact recording signals and generates final instrument signals based on the 
channelized contact recording signals. The simulation system 20 further includes 
a reproduction system 70 for generating audible sound waves based on the final 
instrument signals, where the sound waves simulate the ensemble sound pattern. 

15 The reproduction system 70 therefore uses the reflection and reverberation 
effects of the listening environment to create the perception that the ensemble 21 
is present and that the ensemble sound pattern is being generated from within 
the listening environment. 

Preferably, the ensemble sound pattern emanates from a plurality of 

20 instruments, and as shown in Figure 2, the preferred embodiment simulates a 
string quartet 21'. It will be appreciated that while it is preferred to simulate a 
string quartet 21', other instruments such as brass or wind instruments can be 
simulated without parting from the spirit and scope of the invention. As shown in 
Figure 3, the signal generation system 30 preferably includes a plurality of 
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contact recording configurations 31 for converting the vibrations from ensennble 
21 into contact recording signals. Figure 4 demonstrates that each contact 
recording configuration 31 preferably includes a pair of contact transducers 
coupled to a corresponding instrument 22. The location of each contact 

5 transducer is governed by listening tests and cross-correlation function 
measurements in different frequency bands at different locations. Specifically, 
each pair of contact transducers includes a first transducer 32 located below an 
F-hole 23 of the corresponding instrument 22. The first transducer 32 generates 
a contact recording signal based on vibrations near the F-hole 23. A second 

10 contact transducer 33 is located under a bridge 24 of the corresponding 
instrument 22. Similarly, the second transducer 33 generates a contact recording 
signal based on vibrations near the bridge 24. As will be discussed below, the 
signals from the transducers 32, 33 are simultaneously recorded to separate 
channels using sound recording techniques well known in the art. Thus, two 

15 channels per instrument are created in the preferred embodiment. 

Turning now to Figure 5, the preferred signal processing system 51 is 
shown in greater detail. The signal processing system 50 includes a storage 
system 51 for storing the contact recording signals to a storage medium 53 as 
channelized data. A retrieval system 52 retrieves the channelized data from the 

20 storage medium 53. It will be appreciated that storage medium 53 is preferably a 
computer readable medium such as a CD-ROM or DVD. As shown in Figure 6, it 
is preferred that the storage system 51 include an analog to digital conversion 
system 54 for generating digital recording signals based on the contact recording 
signals from the signal generation system 30. A recording system 55 generates 

25 the channelized data based on the digital recording signals and records the 




channelized data to the storage medium 53. The signals are therefore 
maintained on separate channels throughout the simulation process. It will 
further be appreciated that as shown in Figure 7, the retrieval system 52 of the 
signal processing system 50 preferably includes an equalization system 56 for 
5 tailoring a frequency response of the channelized data. A mixing system 57 
generates intermediate instrument signals based on the channelized data. The 
preferred retrieval system 52 further includes a digital to analog conversion 
system 58 for generating final instrument signals based on the intermediate 
instrument signals. Thus, amplifier 59 can amplify the final instrument signals for 

10 transmission to the reproduction system 70. 

The reproduction system 70 will now be described in greater detail. Figure 
8 demonstrates that the reproduction system 70 includes a plurality of 
loudspeaker systems 71 , 72, 73 and 74. It is preferred that each loudspeaker 
system 71, 72, 73 and 74 has an assigned instrument and generates audible 

15 sound waves which approximate a frequency dependence of sound wave 
radiation from front, back and side surfaces of the assigned instrument. As best 
seen in Figure 9, the reproduction system 70 may also include a means for 
simulating musician absorption of the audible sound waves such as absorption 
panel 75. It can further be seen that each loudspeaker system includes at least 

20 one front driver 76 having a predetermined front piston diameter for 
approximating the frequency dependence of radiation from front and side 
surfaces of the assigned instrument. Figure 9 further demonstrates that a second 
front driver 77 can also be provided. Furthermore, as cost considerations permit, 
loudspeaker systems can have side drivers 78, 79 to further increase accuracy of 

25 the simulation. As will be discussed later, each instrument has an asymmetrical 
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frequency response. This asymmetrical frequency response is essentially an 
angular dependence of radiation from all surfaces of the instrument. Angular 
dependence can be matched in its coarse structure and approximated in its fine 
structure. 

5 It will be appreciated that the simulation system 20 matches the simulation 

coarse angular dependence to a reference coarse angular dependence by two 
techniques. First, the frequency dependence of the radiation from front and back 
surfaces is approximated by using separate loudspeaker drivers. Thus, back 
driver 80 has a predetermined rear piston diameter for approximating the 
10 frequency dependence of radiation from back and side surfaces of the assigned 
instrument. Furthermore, front drivers 76, 77 reproduce radiation in the forward 
direction of the assigned instrument. The second matching technique 
approximates the polar radiation pattern. The polar pattern on radiation is 
approximated by using drivers with a piston diameter that reproduces the low- 
is frequency lobe in the forward direction. For example, at an angle of 90 degrees 
the radiation from a viola is down 3 dB at a frequency of 1000 Hz. According to 
well-known theories for the radiation of a piston in an infinite baffle, a polar 
pattern with that characteristic requires a piston diameter of about 22 cm. The 
use of separate drivers 76, 77, 78. 79. 80 is further improved with the deployment 
20 of front and back equalizers (not shown) at the input to each driver 76, 77, 78, 79, 
80. 

Turning now to Figure 10, a method for tuning a local performance 
simulation system to the required frequency responses is shown in greater detail. 
Specifically, at step 100, the system overall frequency response is matched to a 
25 known overall frequency response. The method further includes the step 200 of 
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matching the system coarse asymmetrical frequency response and step 300 of 
approximating the system fine asymmetrical frequency response. Figure 11 
shows step 100 in greater detail. It can be seen that at step 101 an instrument is 
selected from the ensemble. The musician then plays scales at step 102, and 
5 contact and acoustic microphone recordings are simultaneously made at steps 
103 and 104, respectively. At step 105, the equalizer is adjusted so that the 
overall frequency response of the simulation, measured in one-third-octave 
bands approximates the overall frequency response of the microphone recording. 
Figure 14 demonstrates that recordings are made with contact recording 

10 configurations 31 as usual and, using a separate recorder, with acoustical 
microphones 25. In constructing the listening system, the loudspeakers are 
adjusted so that when they reproduce the signals from the contact transducers 
31, the long-term spectrum measured with the same acoustical microphones 25 
and the same reverberant environment matches the original recordings. 

15 Perceptually important spectral structures in the real instruments will be captured 
by the third-octave matching technique. 

As noted above, each instrument also has an asymmetrical frequency 
response which has an angular dependence. With respect to coarse structures, 
the overall directional frequency response of musical instruments has been 

20 measured in anechoic rooms by many workers. For example, Jurgen Meyer has 
measured the angular dependence of the frequency response for many 
orchestral instruments including the violin, viola and cello. These responses 
appear in his 1978 textbook entitled "Acoustics and the Performance of Music". 

Turning now to Figure 12, the process of matching coarse asymmetrical 

25 frequency response is shown in greater detail. At step 201, the instrument is 
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selected and at step 202, the reference coarse angular dependence is 
deternnined. The reproduction of the contact recording is matched to the 
reference at step 203 by the loudspeaker design techniques described above. 

As shown in Figure 13, the present invention also provides for matching 
5 the fine asymmetrical frequency response. The fine structure of the radiation 
pattern of a musical instrument is complicated. For violins, the fine structure is 
different from violin to violin. The result of the fine structure is that when the 
musician plays changing notes, the different high frequency harmonics are 
radiated in directions that change dramatically. This effect lends interest to the 

10 sound of the instrument and the tone is perceived as being more lively. The 
present invention does not attempt to reproduce the fine structure of any 
particular instrument. What is thought to be important is simply that some 
complicated fine structure be present. For each instrument of a stringed quartet, 
multiple loudspeakers can be used. Each speaker is driven by a weighted 

15 mixture of bridge and F-hole signals with possible inversion. The resulting 
interference pattern leads to the fine structure of the instrument. At this time, the 
weighting functions and decisions to invert are tuned by ear. Thus, at step 301, 
the instrument is selected and at step 302, the contact recording reproduction is 
matched by ear. 

20 There are numerous alternative implementations of the present invention. 

For bowed string instruments, the individual radiation pattern can be simulated by 
comb filtering as in existing mono to stereo converters. In this case, it is 
adequate to record a single channel for each instrument and tight-miking might 
be used instead of contact pickups. For brass and woodwind instruments, the 

25 recordings can be made with mouthpiece pickups. After filtering, these 




recordings are reproduced through characteristic loudspeakers. Brass 
instruments use a single piston driver of appropriate size, whereas woodwind 
instruments require a more complicated design. 

It is to be understood that the invention is not limited to the exact 
5 construction illustrated and described above, but that various changes and 
modifications may be made without departing from the spirit and scope of the 
invention as defined in the following claims. 
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